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Abstract. The housekeeping heat Q^k i s the dissipated heat necessary to 
maintain the violation of detailed balance in nonequilibrium steady states. By 
analyzing the evolution of its probability distribution, we prove an integral 
fluctuation theorem (exp[— /3Qhk]} = 1 valid for arbitrary driven transitions 
between steady states. We discuss Gaussian limiting cases and the difference 
between the new theorem and both the Hatano-Sasa and the Jarzynski relation. 

Introduction. - Steady state thermodynamics provides a framework for describing 
transitions between different nonequilibrium steady states using terms familiar from 
ordinary thermodynamics P3 El dj< As a crucial concept, the division of the total 
heat dissipated in such transitions into two contributions, a housekeeping heat 
Qhk and an excess heat Q e x, has emerged. The housekeeping heat is the one 
permanently dissipated while maintaining a nonequilibrium steady state at fixed 
external parameters a. The excess heat is the one associated with a transition between 
different steady states caused by changing a. For transitions between equilibrium 
states the housekeeping heat vanishes and the total heat reduces to the excess heat. 
These concepts have been made explicit in the model of a colloidal particle driven along 
a one-dimensional coordinate described by a Langevin equation In particular, 

it was shown that the excess heat Q ex obeys a fluctuation theorem 

(cxp[-/3Q cx - A0]) = 1, (1) 

where <j)(x,a) = — lnp s (x, a) with p s the steady state probability distribution for 
fixed external parameters a. The brackets (• • •) denote an average over many different 
realizations of the process in a surrounding heat bath of inverse temperature (3 = 
l/ksT. Since the average (A</>) can be identified as the change in generalized system 
entropy AS, the relation AS* > — /3 (Q C x) following from equation (JJJ corresponds to a 
generalization of the second law to transitions between two different steady states ■ 
An experimental test of this fluctuation theorem was realized using laser tweezers 
dragging a colloidal particle through a viscous fluid In this Letter, we prove a 
similar fluctuation theorem for the housekeeping heat 

(exp[-/3Q hk ]} = 1 (2) 

valid for arbitrarily driven systems described by such a Langevin equation. 

Integral fluctuation theorems of the type (exp[— A]) = 1 have been derived and 
the corresponding probability distribution P(A — a) has been discussed for a variety 
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Figure 1. A periodic potential V(x, A) with period L = 2ir, where x is the 
angular position of a driven colloidal particle moving through a viscous fluid 
representing the surrounding heat bath. Depth and shape of the potential depend 
on the externally controlled parameter A. A force / can be applied directly to the 
particle. 



of systems showing an underlying stochastic dynamics |SJ [3 El El IQ3 IH1 1121 1131 . 

The most prominent example is the Jarzynski relation where A is the dissipated 
work spent driving the system from one equilibrium state to another. Crucial for the 
Jarzynski relation proper is the fact that the system obeys detailed balance for fixed 
external parameters a. However, even if this is not the case, by applying the same 
reasoning a Jarzynski-like relation 

<exp[-/3Q tot - A4>}) = 1 (3) 

can be derived, which differs from equation JQl by using the total heat Qtot as shown 
below. It is crucial to appreciate that all three relations lll.'il) are genuinely different 
and require a different derivation. 

Such integral fluctuation theorems should be distinguished from the detailed 
fluctuation theorem P(—a)/P(+a) = e~ a valid for a probability distribution P(a) 
in steady states at constant external parameters. Such a theorem was discussed first 
for entropy production in sheared two-dimensional fluids |151I16| and later generalized 
to chaotic and stochastic dynamics |171 1181 1191 12U| . It even holds for periodically 
driven systems as demonstrated experimentally using a single two- level system |21| . 

The model. - As paradigm, we will focus on driven diffusive motion of a single 
colloidal particle in one dimension. The potential V(x, A) = V(x + L, A) is spatially 
periodic with period L and depends on an external parameter A, see figure ^ The 
Langevin equation for the position ^ x{t) < L of the particle becomes 

7i = -V + f + r), (4) 

where V = dV/dx and f(t) is a time-dependent nonconservative force. The thermal 
noise 77 obeys the usual correlations {ri{t)ri(t')) — 2(j/f3)5(t— t') with friction coefficient 
7. The externally controllable parameters of the system are a = (A,/). A transition 
from ag = a(0) to a t = a(t) occurs along the path a(r) through parameter space. 

Following Sekimoto 0], we write the total exchanged heat between system and 
reservoir in the time interval ^ r ^ t as the functional 

QtotKr); a(r)] = f dr x(r) [/(r) - V'(x(r), A(r))] . (5) 
Jo 

We take the sign of the heat to be positive when energy flows out of the system into 
the heat bath. 
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In the case of genuine nonequilibrium states where p s (x,a) violates detailed 
balance at fixed a (in our model for / ^ 0) it makes sense to split up the total 
heat into the housekeeping heat, i.e., the part needed to maintain the violation of 
detailed balance 

Qhk[x(T);a(T)) = 7 / dr x(r)i/ s (x(r), a(r)), (6) 
Jo 

and the excess heat Q cx = Qtot — Qhk E] The function v s is the local mean velocity 
of the particle in the steady state at fixed a, 

v s {x,a) = — -, (7) 

p B [x,a) 

where j s is the steady state probability current. 

Evolution equation. - In the definition © of the housekeeping heat the singular 
velocity x appears, which requires a regularization. We therefore introduce the 
momentum p — mi of the particle with mass m as an additional degree of freedom, 
even though we are considering the overdamped case. Then the coupled Langevin 
equations become 

x = p/m, (8) 

P = f-V'-tf/m)p + ( with <C(*)C(0> = 2(7//W-*'). ( 9 ) 
q = (■j/m)pv s . (10) 

In equation q is the dissipation rate of the housekeeping heat J§J| with x 

replaced by p. The joint probability p(x,p, q,t) to find the particle at position x 
with momentum p and to have spent a housekeeping heat q up to time t obeys the 
generalized Fokker-Planck equation 



d t p = 



-d x + (V - f)8 p + ed pP + e^8 2 p - ^pv s 8 q 



p. (11) 



Since Qhk was defined for overdamped motion, we fix the friction coefficient 7 and use 
e = 7/m as expansion parameter to recover the appropriate dynamics for Qhk in the 
limit of large e. 

Adiabatic elimination of fast variables is a standard technique in stochastic 
dynamics |22| . To simplify notation we introduce the two differential operators 

C p = d p \p + (m/0)d p ], (12) 
A = { P /m)d x - {V - f)d p + { 1 /m)pu s d q , (13) 

where we use the usual convention that a differential operator like d x acts on all factors 
placed to its right. Using these operators, we rewrite equation (|TT)l as 

dtp - [eC p - A] p. (14) 

Further we define a projector by 



Vip(x,p) = ip (j>) / dv tp(x,p), (15) 



where the Maxwell distribution tpo(p) = \fp T ] the stationary solution 

of Cpipo — 0. This ensures the two important properties 

VC P = C p V = 0, PAi'o =0 (16) 
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of the projector V . Now we decompose the joint probability p = p + p~\ into a part 
"parallel" to the stationary distribution 

p = Vp = pVo (17) 

and a part perpendicular, pi = (1 — V)p. The function 

p(x,q,t) = J dp p(x,p,q,t) (18) 

is the probability distribution we are looking for. Physically, this scheme corresponds 
to a decomposition into a part for which position x and momentum p are uncorrelated 
and into a deviation p\. For uncorrelated stochastic variables the joint probability 
decays to the simple product 1(17)1. 

Taking advantage of the properties (|16f) the coupled equations of motion become 

d t p = -VAp x , (19) 
d t pi = eCpP! -Ap -(1- V)Api . (20) 

The second equation 1|2U[I can be expanded into powers of yielding up to the first 
order p\ ~ e~ 1 C~ 1 Apo- Putting this back into equation i|19|) we finally arrive at 



dtp = -£ 1 



J dpAC^Atpo 



p. (21) 



For the calculation we insert definition (|T3)l and note that C p 1 ptpo = —pipo- Gaussian 
integration then leads straightforwardly to the evolution equation 

d q , vldl 



d t p 



C + 28 x v s 



(22) 



D ) 13 D f3 2 

where we have set 7 = 7 and used the Einstein relation D = 1/7/3. The operator 

C = d x [(V - f)h + Dd x ] (23) 

is the usual Fokker-Planck operator. The probability distribution of the housekeeping 
heat 

P{q,t) = J dxp{x,q,t) (24) 

can then be calculated simply by integrating over x. Since we start in a steady state, 
the initial condition needed to solve equation l|22l) is p(x, q, 0) = p s (x, ao)S(q). 
Proof of the fluctuation theorem 0). - In the time derivative 

d t <exp[-/?Q hk ]> = J dxdq e-P«d t p(x, q, t) (25) 

we insert the equation of motion 122(1 and get rid off the partial derivatives with respect 
to q by integration by parts with vanishing boundary terms. We then have 

d t <exp[-/?Q hk ]} = J dxdq e-top{x, q, t)[- V 2 s + is 2 ]/D = 0. (26) 

Therefore the average over trajectories of length t becomes 

(exp[-/3Q hk ]) t - (exp[-/?Q uk ]) - 1, (27) 

since for t = we start with Qhk = 0. This proof of the fluctuation theorem for 
any time-dependence a(r) is the central result of this Letter. 
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Mean and variance. - In order to obtain an explicit expression for the mean of 
Qhk; we integrate equation (|22[) with J dxdq q and obtain after integration by parts 
with respect to q 



dt (Qhk) = 7 J dx v 2 (x,a)p(x,t) = 7 (if (a)) > (28) 

and hence 

(Qhk) =7 / dr (^V(t))) >0. (29) 



In general, the average over 1^ has to be taken using the time-dependent probability 
p(x, t) of the position x. However, in a steady state we have p(x, t) — p s {x, a) and the 
mean becomes 



3s I dx P~s 



t, (30) 



leading to a constant mean dissipation rate. 

Applying the same scheme to the second moment leads to a variance 

o 2 = 2 7 f dr <^ 2 ( a (r))g hk (r)) + (2//J) (Q hk > - (Qhk) 2 . (31) 
Jo 

The variance thus involves weighting the housekeeping heat with the square velocity 
v 2 in the first term. This recursive scheme can be continued to obtain any moment or 
cumulant as a function of all previous moments or cumulants and the weight function 

Limiting cases. - In the limiting case V <C / which corresponds to the situation 
where / is large such that the particle hardly "feels" the underlying potential we can 
solve equation (|22[) exactly. Then the stationary distribution becomes uniform and 
v s {t) rj /(r)/ 7 . By integrating over x in equation (1221 we get for the probability 
distribution P(q, t) the evolution equation 

d t P = -T l fd q P + Df 2 d 2 P. (32) 

This is a diffusion-like equation and its solution is a Gaussian with mean 

(Qhk) -7" 1 / dr/ 2 (r) (33) 
Jo 

and variance a 2 = (2//3) (Qhk), which obviously obeys the integral constraint implied 
by the fluctuation theorem @. 

In the opposite case V ^> / for a = the local mean velocity v s is small, 
which we make explicit by v s — > ev s . Now a time scale separation using e as a small 
parameter becomes possible. The fast time variable is simply t whereas the slow time 
variable s = et is given by the "hopping time", i.e., the mean time the particle needs 
to complete one period. Switching to the slow time scale p(x,q,s), equation (12211 
becomes 



d s p = 



e C+\2d x v s -e D j ^ +e^ 2 



p. (34) 



In order to eliminate x for small e, we apply exactly the same scheme developed above 
for elimination of the momentum p for large friction 7. Again dividing the distribution 
p into a part parallel to the stationary distribution po^, q, s) = P{q, s)p s (x) and into 
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General 


DBS 


NESS 


Qhk = 0, R = Y = 8W d i, 


Y = 0, R = l3Q hk 


(1) 


<exp[-Y]> = 1 


(cxp[-fWdi s ]} = 1 


1 = 1 


(2) 


(cxp[-/3Q hk ]> = 1 


1 = 1 


<cxp[-3Q hk ]> = 1 


(3) 


(exp[-fl]> = 1 


(cxp[-/W dis ]> = 1 


<cxp[-/3Q hk ]> = 1 



Table 1. A classification of isothermal nonequilibrium processes and the 
corresponding integral fluctuation theorems 11131 . Here Y = /3Q C x + A0 and 
R = fiQtot + A0. The second column holds for transitions o(t) where for fixed 
a the system is in a detailed balanced state (DBS). The third column holds in 
nonequilibrium steady states (NESS) with broken detailed balance. 



a part p\ perpendicular, we see that p\ is of order e 2 . If we take into account only 
terms of order e and restore the original variables, we get the evolution equation 

d t P = - 7 (^) d q P + ( 7 //3) {^) d 2 q P. (35) 

Its solution again is a Gaussian with mean l(3"Uj) and variance a 2 = (2//3) (Qhk)- 

Relation to other fluctuation theorems. - Finally, we discuss the connection 
between the new integral fluctuation theorem J2J and the Hatano-Sasa relation (QJ 
as well as the Jarzynski-like relation For a transition along a(r) the latter two 
involve the dimensionless functional 

Y[x(r);a(T)]= [ dr d(r)|^(ar(r),a(r)), (36) 

for which Hatano and Sasa show (exp[— Y]) = 1 [5]. With the boundary term 

A<j) = cp(x(t),a t )-<p(x(0),ao) (37) 

and Y = (3Q CX + A</> this leads to relation . 

Relation J3J follows by applying the same reasoning used for deriving the original 
Jarzynski relation (HJ[71|S] to the present case of broken detailed balance. The ratio of 
the probability of the trajectory x(r) to the probability of the time-reversed trajectory 
x(t) = x(t — t) under the time-reversed protocol a(r) = a(t — r) is given by 

or i \ ( M -i prob[x(-r); q(r)] p s (x(0), a ) 

R[x{T);a{T)\ = In — — . = (3Q to t + A</>. (38) 

prob[x(T); a[r)\ p s (x{0), a ) 

Here, prob[x(r); a(r)] is the probability of a single trajectory x(t) under the protocol 
cy(t) starting in microstate x(0). It is easy to show (exp[— R]) = 1 and hence 
relation © follows. 

Isothermal nonequilibrium processes are therefore characterized by the two 
trajectory dependent functionals Y and Qhk, and a boundary term A<fi. Both 
functionals and their sum 

R = Y + (3Q hk = /3Q tot + A4> (39) 

obey an integral fluctuation theorem as summarized in table ^ However, there are 
two special cases in which two of the three become identical and the third one trivial. 
First, if for any fixed a reached along the transition a(r) the system obeys detailed 
balance we have Qhk = 0. The stationary distribution then is simply the Boltzmann 
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distribution with <p(x, a) = (3[H(x,a) — F(a)], where H(x,a) is the Hamiltonian of 
the system and F(a) is the free energy. Inserting this <j> into equation (|36|l . we find 
that Y is the dissipated work 

R = Y = /3[W — AF] = f3W dis (40) 

and the relations Q and © become the Jarzynski relation [Jj]. Second, in a 
nonequilibrium steady state with a = we have Y = and R = /3Qhk, and the 
relations an d © become identical. In such a steady state, R — /3Qhk can also 
be interpreted as total entropy production, which then obeys a detailed fluctuation 
theorem P(—R)/P(R) = e~ R even for finite times 

Summary. - We have derived and discussed a new integral fluctuation theorem 
for the housekeeping heat valid under arbitrary time-dependent driving. Even though 
we focused on one-dimensional motion it is obvious how to generalize our approach to 
coupled Langevin equations describing interacting systems. It would be interesting 
to test experimentally all three integral fluctuation theorems and to measure the 
corresponding probability distributions, in particular, in nonharmonic time-dependent 
potentials, where a priori one does not expect Gaussian distributions. 
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